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Abstract 

The adjacency and Laplacian matrices of complex networks with 
two species of nodes are studied and the spectral density is evaluated 
by using the replica method in statistical physics. The network nodes 
are classified into two species (A and B) and the connections are made 
only between the nodes of different species. A static model of such 
networks with power law degree distributions is introduced by apply- 
ing Goh, Kahng and Kim's method to construct scale free networks. 
As a result, the spectral density is shown to obey a power law in the 
limit of large mean degree. 
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1 Introduction 



The theory of complex networks, which has dramatically been developed 
since the end of the last century, is based on the observation that there 
are universal features in real biological and social networks [T]. One of such 
features is the scale free property, meaning that the degree (the number of 
nodes directly connected to each node) distribution function P(A) obeys a 
power law P(A) oc A~ A for large A. Barabasi and Albert explained the origin 
of this scale free property by focusing on the network growing process[2]. 
Goh, Kahng and Kim formulated a static network model which exhibits the 
scale free property [3J. 

The connection pattern of a network is mathematically described by the 
adjacency matrix. When the network has the scale free property, the spectral 
(eigenvalue) density p(p) of the adjacency matrix is also expected to obey a 
power law p(p) oc p -7 for large p. Dorogovtsev et al. presented an analytic 
evidence of this power law behaviour [H [S]. Moreover a relation 7 = 2A — 1 
was found between the exponents of the power laws. Rodgers et al. analysed 
Goh, Kahng and Kim's static model and confirmed the power law behaviour 
ofp(p)[6]. 

In this paper, we shall study scale free networks with two species (A 
and B) of nodes. The connections are made only between the nodes of 
different species. We introduce a static model of such scale free networks by 
applying Goh, Kahng and Kim's method, and observe that each species has 
its own degree distribution function obeying a power law. Suppose that the 
exponent of the degree distribution function is A a for the species A and \b 
for the species B. Using the replica method in statistical physics, we are able 
to analytically evaluate the spectral density p(p) in the limit of large mean 
degree[6l [H [8]. As a result, we find that p(p) also obeys a power law and 
the exponent 7 is associated with the exponents A^ and A#. In addition, the 
spectral density of the Laplacian matrix is similarly analysed and the power 
law behaviour is confirmed. 

The outline of this paper is as follows. In §2, a static model of scale 
free networks with two species of nodes is introduced, and the adjacency 
and Laplacian matrices are defined. In §3, in order to evaluate the spectral 
density, we apply the replica method to the network model. In §4, in the 
limit of large mean degree, the power law behaviour of the spectral density 
is analytically derived. In §4, the effective medium approximation is briefly 
discussed as an attempt to treat the case with a finite mean degree. 
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2 Complex Networks with Two Species of Nodes 

Let us suppose that there are N nodes of type A and M nodes of type B 
(N > M). We are interested in the asymptotic behaviour of networks with 
two species of nodes A and B in the limit 

N ->• oo and M ->■ oo with c = N/M fixed. (2.1) 

We introduce a static model of such networks with power law degree distri- 
butions by applying Goh, Kahng and Kim's method. Each node of type A 
is assigned a probability Pj normalised as 

N 

while each node of type B has a probability Qk with 

M 

£<?* = !■ (2.3) 
k=l 

The nodes of type A and B are connected according to the following proce- 
dure. In each step we choose a node j of type A and a node k of type B with 
probabilities Pj and Q k , respectively. Then the nodes j and k are connected, 
unless they are already connected. After repeating such a step pN times, a 
node j of type A and a node k of type B is connected with a probability 

f jk = 1 - (1 - PjQ k y N ~ 1 - e~ pNP i Q K (2.4) 

Let us consider an iV x M matrix C (N > M), where Cjk = 1 if the 
node j of type A is directly connected to the node k of type B, and Cjk = 
otherwise. This random matrix C describes the connection pattern of the 
network with two species of nodes. Eacn matrix element Cjk is independently 
distributed with the probability density function (p.d.f.) 

Vj k {Cj k ) = (1 - f jk )S(C jk ) + fj k 8{\ - Cjk). (2.5) 

We assume that Pj and Qk are given by 

Pj = ~ (1 - a)N a ~ l r a , < a < 1 (2.6) 

i=i 



(2.2) 
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and ^ 

Q*=4 (l-^M^ 1 ^, O<0<1. (2.7) 

1=1 

There are thus two parameters a and (3 controlling the p.d.f. of the matrix 
C. 

We define the degree dj of the type-A node j as the number of directly 
connected type-B nodes: 

M 

dj = E C jk . (2.8) 

k=l 

Then the type-A node degree distribution function is given by 

^ (A) (A) = ^E5(A-^, (2-9) 

where the brackets denote the average over the p.d.f. (12.51) and S(x) is Dirac's 
delta function. We can similarly introduce the degree e k of the type-B node 
k: 

N 

e k = J2 C ik ( 2 - 10 ) 

3=1 

and the type-B node degree distribution function 

^ (B) (A) = ^E5(A- efc )^. (2.11) 
In Appendix, a useful asymptotic relation 

/ / N M \ \ N M 

In ( exp l-i J2 E Ciktjk ~#EE PjQk(e- u >* - 1) (2.12) 
\ \ j=i fc=i / / j=i k=i 

is derived in the limit (12. ip . Here tjk, which depends on neither N nor M, is 
in the neighbourhood of the origin so that \e~ lt 3 k — 1| < 1. 

As special cases, we can readily derive asymptotic relations for 

Fj A \t) = In (e-^*) , F { k B \t) = In (e~ ieki ) (2.13) 

as 

F^ A \t) ~ P NP,{e- u - 1), F { k B \t) ~ P NQ k (e~ u - 1). (2.14) 
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Then we can readily see that 



t=o 

~ pNQ k , (2.15) 



t=o 

so that the mean degree wS A ' of the type-A node is 



m 



(A) 



1 w 



N ■ 



E< d i>~p. ( 2 - 16 ) 



while the mean degree m( B ) of the type-B node is 

i M 

™ (B) = T7£(e*>~Pc. (2.17) 
iKJ fc=l 

It can be seen from (I2.6p . (12. 9p and (12.1 4p that the type-A node degree 
distribution function can be written as 

~ — / dt / dxexp{zAt + p(l-a)x- a (e- i '-l)}.(2.18) 
Then in the limit A -> oo we find 

P<")(A) ~ | dz * {A - P (l - „)x-} = {P(1 " a a)} ' / ° A(1/ V 1 . (2-19) 
and similarly obtain 

PW(A) ~£dy5{A- pc(l - = l|t "/ l "' a „; 4 , (2.20) 

Thus we have seen that the network has the scale free property, as the node 
degree distribution functions obey power laws. The exponents of the power 
laws defined as 

P (A) (A) oc A~ Xa , P (b) (A) oc A- Xb , A^oo (2.21) 
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are found to be A^ = (l/a) + 1 and A# = + 1. 

In this paper we study the adjacency and Laplacian matrices of this scale 
free network. The adjacency matrix A of this network is defined as 

where C T is a transpose of C and O n is an n x n matrix with zero elements. 
The Laplacian matrix C is an (N + M) x (N + M) symmetric matrix with 

dj, j '• = I and 1 < j < N, 

ej _ N , j = I and N+l<j<N + M, (2.23) 
-Aji, j ^ I 

Let us define that J is the adjacency matrix A or the Laplacian matrix 
C. The spectral density of J is defined as 

/ i N+M \ 

where /ij, j — 1,2, N + M are the eigenvalues of J. In order to calculate 
we introduce the partition function 

. N+M I ■ N+M ■ N+M N+M \ 

zdi) = / n d ^ ex P h^ $ r9E E ■/A-^i • (2-25) 

J 3=1 V i =1 i =1 '=1 / 

Using the partition function Z, we can write the spectral density as 

M = ^^^ImTr^J-^ + ie)/}- 1 

2 9 

Im— (lnZ(/i + k)), (2.26) 



(N + M)ir dfi 

where e is an infinitesimal positive number and / is an (N + M) x (N + M) 
identity matrix. Then we can utilise the relation 

lim H^!) / lnZ \ (2>27) 

to obtain 

^=^wrm^ m i H[mT) - (2 ' 28) 

Therefore it is necessary to evaluate the average {Z n ). The replica method 
explained below is known to be a powerful tool for that purpose. 
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3 Replica Method 

Let us first discuss the spectral density of the adjacency matrix A. The eigen- 
values fij, j = 1, 2, • • • , iV + M of A consist of M pairs ±Uj, j = 1, 2, • • • , M 
and N — M zeros. Note that Uj > are identified with the eigenvalues of the 
M x M correlation matrix V with 

JV 

Vm = / J CjhPu- (3.1) 

Using the notations 

4>j = $j, j = l,2,---,N (3.2) 

and 

</> fc = <W, fc = l,2,-.-,M, (3.3) 
we can rewrite the partition function Z as 

- N . M ( i N i M N M 

= / II d h < II d ^ ex p n/* E $ + E V'* - * E E Cj^jipk 

J j=l J k=l \ / 3=1 / fc=l 3=1 k=l 

(3.4) 

Then we introduce the replica variables 

$ s = (<t>?\ <f>f\ • ■ ■ , $ } ), & = (tf >, 4 n) ) (3-5) 

and 

d^- = d0fd0f } ■ • • d<^ n) , d$ k = dipjpdipj® ■ ■ ■ d^ n) (3.6) 

to obtain 

at m ( ■ n ■ m _^ 



V M 

x ( exp I -i £ E Q fc 0j- • ^ fc I ) . (3.7) 



j=i fc=i 

Now we can see from (12.121) that 

JV M \ \ I N M 



exp -«EE G M • A ) ~ ex P E E p ^ ( e ~ % "^ - ■ 
j=i fe=i / / [ i=i fe=i j 

(3.* 
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It should be noted that this asymptotic relation holds if <f>j ■ ipk is in the 
neighbourhood of the origin. This condition is justified in the limit of large 
mean degree p — > oo, since <\P- and ipl are scaled as 0(p -1 / 2 ) or 0{p^ 1 ) (see 
eqs. gSJ) and (OS}). 
Using the notation 

£ j ($) = 6($-$ j ), fj k {f) = 8^—$ k ), (3.9) 

we obtain 

/ / N M 

( exp \-iJ2 Yl C ik<frj ■ $k 

N M 



exp piV£ E P jQk Jd$Jdj ijiftfjS) { e 



3=1 k=l 

so that we find 

N „ M 



(3.10) 



(z») ~ / n d& f n d ^ 

J j=l J k=l 

\ i N r - ~ - - z A/ / ■ . 
x exp I -nY, J # O(0)0 2 + 2^J d ^ WW 

\ 3=1 k=l 

N M r r 

pNYY p jQk J dfj d^ ij($)7j k (j>) [f{l$) - 1} 



x exp 



3=1 k=l 

N , M , N M 

ijd^ u^k n^i(«s / 

i=i fc=i i=i J fc=i 

x nn^* - &$» n n^*(* - e5i+& ( 3 - n ) 

i =1 ^ fc=1 v> 

Here 

f($,$) = e**, (3.12) 

Si = ^T.j^ ^(0)0 2 + ^E/ d ^ WW (3-13) 
j=i fc=i 
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and 



n m r r 

S2=pNY,H PjQk / d0 / d^ Vk (j) {/(0, 6) - l} . (3.14) 
j=i k=i 



The functional integrations are taken over the auxiliary functions £j(0) and 
rjk{ip) satisfying 

[dj Vk (j) = l. (3.15) 



If J is the Laplacian matrix C, we can similarly derive the same formula 
( BZET$ for (Z n ), except that 



/(0,^=e^ ( ^ 2 . 
It can readily be seen that 



N _ N 

i =1 i =1 



(3.16) 



i'V 



A' 



where 



II d< A? / II^J'W ex P 

N 

Y[ Daj(<f)) exp 
3=1 



In 



£{2™ / d^ ^.(0)^(0)-^. 
,=1 1. j 



(3.17) 



0i exp|-2vri y d0 a,- (0)^(0) 
— In y d0j exp |— 27ua J -(0j)j . 



(3.18) 



In the limit N — > 00, the dominant contribution comes from the stationary 
point satisfying 
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which means 



2m I d0 ^(0)^(0) -Fj\ = 2vr^(0) - 2me~ 2 ^ W+F > = 0, 

(3.19) 



Z,(o) In 0(o) = 27ri / d0 a, (0)0(0) - 



(3.20) 



Therefore we find an asymptotic estimate 

N N ( N 



J II d <^' UU^M - &(0)) ~ exp - £ [ dj 0(0) 1*0(0) • (3.21) 

.7=1 .7=1 ,? I .7=1 I 



One can similarly derive another estimate 



r M - M - - { M r 

/ II II n s (Vk(4>) - Vk(4>)) ~ exp ^ - £ / d$ r) k (if) lnr) k (if) 

fc=l k=l X I fc=l 



fc=l fc=l ^, 

in the limit M — > oo. Then we arrive at 

TV M 



(z n ) ~ / n ^(0) n e 5 ° +si+& , 
i=i fc=i 



(3.22) 
(3.23) 



where 



Sb = -£/ d0 0(0)1*0(0) - £ /¥ ifr($lnifr($. (3.24) 
j=i J fe=i J 

The functional integrations over 0(0) and 77fc(-^) are dominated by the 
stationary point satisfying 

5 1 50 + ^ + S 2 +pfy (j d0 0(0) - l) + X>* (/ ¥ %W - l) j = 0, 

(3.25) 

where 9j and Uk are the Lagrange multipliers. It follows from this equation 
that 



0(0) = e i ex P 
r] k (tp) = ex P 



-/x0 2 + pNP 3 Y^Qkj dfaiJ) {/(<?, $ - 1} 
fc=i 

-•AT 

-/# 2 + piVQ fc £ P, / d0O(0) {/(0, $ - l} 

2 .7=1 J 



(3.26) 



where 9 7 - and fifc are normalisation constants. 
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4 The Limit of Large Mean Degree 



In the limit of large mean degree p — > oo, the variational equations (I3.26p 
are satisfied by the Gaussian ansatz 



(27rwr,-) n/i 



exp 



(2mT k ) n / 2 



exp 



?/> 2 



2%Th 



(4.1) 

as shown below. Here Imcij < and Imr^ < 0. Putting the Gaussian ansatz 
(143]) into (jgZSID , we find 



— # 

= ©i exp 
?7 fc (V') = fy- exp 



M 

+ P ivp ? ^g fc {/i fe (0 2 )-i} 



W 2 + P iVQ fc 5:p :; {^(^ 2 )-i} 



fe=i 

N 



3=1 



where 



exp — 



exp 



2(1 - T fc ) 



If J is .A, 
| , If J is £ 



(4.2) 



(4.3) 



and 



exp ( — —f 



■J Jp 
i 



exp 



2(1 - a* 



If J is A, 
If J is C. 



(4.4) 



Let us first consider the adjacency matrix A. We are in a position to take 
the limit p — > oo with the scalings 



^ = 0{p 1 ' 2 ) 



Then we obtain 



0(p- 1/a ), ^ = 0(p-^), ^ = 0(p-^), 7* = 0(p- l/a ) 

(4.5) 



I M I 

/i pivp,- E <2* r * = °> v P N Qk E p 3*j = °- ( 4 - 6 ) 



k=l 



Tfc 



3=1 



The variational equations (I3.26P are satisfied by the Gaussian ansatz ( 14.1 J) , 
if (jj and are determined by these equations. 
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In order to analytically treat ( 14. 6p . we define the scaling variables 

E = fi/y/p, 8{x) = y/ji(Tj, x=j/N, t(y) = y/pn, y = k/M. (4.7) 
Then it is straightforward to find 

-y— - = Ex a (1 a)(l - 0) ^ y-H{y) dy (4.8) 
s{x) Jo 

and 

Ey? - c(l - a)(l - p) f x~ a s(x) dx (4.9) 

Jo 



t(y) 

in the limit (12. ip . Using the notations 
S = c(l-a)(l-P) [ x- a s(x)dx, T = (l-a)(l-p) [ y- p t(y)dy, (4.10) 

JO JO 

we obtain 



c(l-a)(l-0) Jo Ex a — T ' (l-a)(l-/9) ./o Ey? - S 

. (4.11) 

In order to evaluate the behaviour of S and T in the tail region E — > oo, 
we write 

5 = £(s (fi) - is (/) ), T = £(t (fl) - it w ) (4.12) 
with real s (7) , and t (/) . Then it can be seen that 

E(sW - is^) lr l 1 , If 1 s ^- a ^ a 

-dx = — - / 77^ -rrrds 



c(l-a)(l-/3) E Jo x a - + itW «£jo s-tW+itW 

1 ,(H/«f s _i(fl)) j /-l s (l-a)/c« +(/) 

J ds-— - , ff .._ ■ T-TT^ dg. (4.13) 



a£jo (s - fW) 2 + (t( J )) 2 a£jo (s-*(*)) 2 + (fW) 2 
Let us employ an asymptotic formula [6 J 

Tt5{u-a), e|0 (4.14) 



(u — a) 2 + e 2 
and obtain an estimate 

E(sW+isW) 1 /-i 



c(l-a)(l-/3) 



_J_ / s (V«)-2 ds _ ^ /■ s a-)/^ (s _^)) ds 
a £7 jo a£7 Jo 

1 /7r ( t (H))(l-a)/« j j g;_ >00) (415) 



£7(1 -a) 
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so that 



S ( R ) „ c(l - g) _ c(l-a)(l-^)7r ^ flha _ ( „„,, 



E 2 ' a£ 2 
One can similarly derive 



(4.16) 



(l-a)(l-P) EJo yP-s( R ) + isW (3E Jo t - s( R ) + isW 
' |^-( S («))M/^ E^oo, (4.17) 



£(1-/3) /3£ 
so that 

t W „ t W „ {1 ~ a) ^~ ® n ( a Wf-fi)/P. (4.18) 

It follows from ( I47L6]) and ( g3Bj> that 

Now we can evaluate the asymptotic behaviour of the spectral density 
p(/i) in the tail region E — > oo. Eqs. f!2.28j) and f !3.23|) can be utilised as 

2 9 
p(/i) = lim — — — Im— (So + Si + S 2 ) 

1 / N r - - - M /• ^ 

= £s (FTMR Re ( § / d * fe < ^ + § / d *' * 

1 



i=i fc=i ■ 

TV Af 
j=l fc=l 



in the limit (12. ip . Here 



(JV + M)vr 

- — — Im (c f 1 s(x)dx + f 1 t(y)dy] (4.20) 

+ C)7T \ JO JO J 



1 r 1 1 IT/" 1 1 

5(x)dX = io E-T^ dX= E + EJo Ex^-f dX 

= i + ^ (421) 
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and we can similarly obtain 

Then it can be seen from f H~T6j) . ffl~T8]) and p5| that 

p(/i) ~ -^(i + cMi-«)(i-« Im(5T) 



V^(l + c)7r(l-«)(l-/3) 

" + LrcJ+i • ( 4 -23) 



+ c) \ /3E( 2 // ? )+ 1 a£( 2 / Q ) +1 

This gives the asymptotic spectral density of the adjacency matrix A in the 
tail region E — > oo. The exponent 7 of the spectral density defined as 

p{n) oc /i" 7 , /i -)> 00 (4.24) 

is (2/a) + 1 if a > /3, and is {2/(3) + 1 if fl > a. Thus 7 is associated with 
Xa = + 1 and A# = (V/?) + 1 as 7 = 2min(A J 4, A#) — 1. 

We next compute the spectral density of the Laplacian matrix C Using 
the scalings 

/i = 0(p), $ 2 = o{ P - 1 ), <Ti = 0{p-\ j 2 = 0{p- 1 ), r^Oip- 1 ) 

(4.25) 

and taking the limit p — > 00, we find 

li - — - pNPj = 0, p piVQ fc = 0, (4.26) 

so that 

1 

/i + ie — pNPj 



Imaj = Im : = —7c5(fi — pNPj), 



lmr k = Im — — — - — tttz- — —tt5(ji —pNQ k ), (4.27) 
H + ie — pNQ k 

where e is an infinitesimal positive number. Then it follows in the limit (12. ip 
that 

N 



Im gj ~ —Ntt / dx 5(fi — p(l — a)x~ 
j= i J o 



fp(l _ a )Y /a 1 
- N - a H ^^ Hiv-pil-a)} (4.28) 
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and 



M h 

lmJ2n Mtt / dy6(ji-pc(l-P)y- p ) 



{veil - 6)\ 1/IS 1 

where 



Therefore we arrive at 



1 



N M 



p^) = -jw- Xfw Im E^ + E 7 * 



(iV + M)tt 



U=l fc=l 



(i + c) a ^ron ^^-^ 1 -^ 

-fpcfl - /3H 1//3 1 

+ (i + c)" ^m ^^-^-W- < 4 - 31 ) 

This gives the asymptotic spectral density of the Laplacian matrix £ in the 
region \i = 0(p). The exponent 7l of the spectral density p(/i) oc /i _TL 
(/i — > oo) is (1/a) + 1 if a > ft, and is (1/ft) + 1 if ft > a. Thus 7^ is 
associated with A a and A# as 7^ = min(A J 4, A#). 



5 Effective Medium Approximation 

In the previous section we have dealt with the spectral density in the limit 
p — > 00. The calculation of the spectral density with a finie mean de- 
gree p is a much more involved problem, for which sophisticated numeri- 
cal schemes have been proposed[9l [10]. In this section we briefly discuss 
a simple approximation method (effective medium approximation) for that 
problem[Hl [TTj H21 H3J EEH EE]- In this approximation, we put the Gaussian 
ansatz (14. ip into the formulas f)3. 13j) . f)3.14p and ( I3.24p . and solve the sta- 
tionary point equations 

^(S + S 1 + S 2 ) = (5.1) 
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and 

^-(S + S 1 + S 2 ) = 0. (5.2) 

In the case of the adjacency matrix A, the above procedure results in the 
effective medium approximation (EMA) equations 



0. 



k=l - a 3 T k 
N 



I n Pa 

p pNQk J2^^ = . (5.3) 

Tfe j=1 1 - CTjTk 

As for scale free networks with a single species of nodes, Nagao and Rodgers 
calculated the 1/p expansion of the spectral density by using the correspond- 
ing EMA equation[15]. A similar analytical treatment could also be possible 
in the present case. Here, however only a result of a numerical iteration of 
( 15.31) is shown in Figure 1 as the EMA spectral density. It is compared with 
the spectral density of positive eigenvalues calculated by numerical diago- 
nalisations of numerically generated adjacency matrices (averaged over 100 
samples). The agreement seems fairly good. 

In the limit a, (3 — > 0, we obtain the adjacency matrix of a classical 
random graph with two species, where the connections are made only between 
the nodes of different species. In that case aj and can be written as a and 
r, respectively, because they depend on neither j nor k. The EMA equations 
become a cubic equation for a 

(g , + e 0,-2) + l g ,_p» + (c-l)(p-l) g+ l =0 

and 

r = C( ^~ 1) + 1 . (5.5) 

These equations are equivalent to Nagao and Tanaka's SEMA (symmet- 
ric EMA) equations concerning the spectral density of sparse correlation 
matrices |14j. and can be analysed in the same way. 

We can similarly derive the EMA equations for the Laplacian matrix L 

as 

M " pNPj ^2 - — = 0, 

°i k=l t-°j-n 
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0.035 




2 4 6 |1 8 10 12 14 



Figure 1: The EM A spectral density (+) and the spectral density of nu- 
merically generated adjacency matrices (histogram). The parameters are 
N = 1000, M = 200, a = (3 = 1/2 and p = 10. 



1 N P 
/i pNQ k J2~i " = 0- (5.6) 

Tk j=1 l-CTj-T k 

In the limit a, (3 — > 0, <7j and r k can again be reduced to a and r, respectively. 
Then we find a cubic equation for a 

(i - c y + 2c+(p ~^ )(1 - c) a 2 + /^-i + ^(p-2^-i) ff + c = 

and 

c 

r=- r . 5.8 

(l-c)fjUT + C 
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Appendix 



In this Appendix, we derive an asymptotic relation 

/ / N M \ \ N M 

In ( exp -i £ £ C jk t jk J J ~ pN ^2 £ PjQkie-"'" ~ 1), (A.l) 

\ \ j=l k=l J I j=l k=l 

where tj k is a parameter which is independent of N and M. We moreover 
assume that tj k is in the neighbourhood of the origin so that \Sjk\ < 1 holds 
for Sjk = e~ lt i k — 1. A similar argument for Goh, Kahng and Kim's model is 
found in [T6] . 

The Taylor expansion of the logarithmic function gives 

/ / n m \ \ N M 

In /exp £ £ C jk t jk ) = £ £ ln(l + f jk S jk ) 

\ \ j=l k=l J I j=l k=l 

N M N M 

= pNj2T, p jQkS jk + J2T,(fjk-pNP J Qk)s jk 
j=i fe=i j=i fc=i 

+ £ LJ ^££(/^ fc f- (a.2) 

1=2 1 j=l k=l 

We show 

/ / N M \ \ N M 

In ( exp i-i £ Cifc^ ) - ^ ^ ^ P.Qfe^ = o(iV) (A.3) 



in two steps. 
Step 1 

Let us first prove that 



N M 

£ £(£* - pNPjQ k )S jh = o(N). (A.4) 
j=i fe=i 
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We define 
and 

Then we see that 

N M 



max \S jk \ 
jk 



GAx) = x — 1 + c~ 



(A.5) 
(A.6) 



EY,(fjk-pNPjQ k )S jk 
j=i fc=i 



N M 

< S max £ £ | /j* - pNPj Q k I 

3=1 k=l 
N M 

= S^^^GtipNPjQk). (A.7) 

3=1 k=l 



A monotonously decreasing continuous function F(x) satisfies 



£F(fc)< / F(y)dy + F(l), 
k=i Jl 



(A.8) 



so that 



k 

with 



£ G^pNP^Qk) < J*' G x (pNPj-^-^j dy + G x [pNP j 



Cm 08). 



M 



Cm(/?) = E' 



Then one can again use (IA.8I) to obtain 



where 



pN rM I 

h = dx dyG x [pN , 

/a = Gx (pN ) s/, m ) , / 3 = f dx G a f piV 

A V Cn(<x)Cm(p) J Ji \ 

h = GApN 



N M 4 

j=i fe=i ^=1 



(A.9) 



(A.10) 



(All) 



x 



Gv(a) Cm(/3). 
1 1 \ 



Civ(a) Cm(/3) 



U«)Cm(/3);' 

(A.12) 
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Using the notations 



Civ(aJ Qm{p) 



we see that 



7l = ^ 1 dM 1 d " u i + d/«) v i + 



(A. 14) 



^ Jet 4 u l+(l/a) v l+(l/« ■ 

Then, using the inequality 

G 1 (x)<x 2 /2, x>0, (A.15) 

we find 

= OiN^-^N^- 1 ^), (A.16) 

where 

[ 1, < a < 1/2, 

iV (2a-i) = J lnA r, a = 1/2, (A. 17) 
( N 20 ' 1 , 1/2 < a < 1. 

In the case min(a,/3) > 1/2, we similarly employ 

G ^^{f/ 2 ' Hi' 1 ' (A- 18) 

to obtain 

I 1 = 0(N( a >V), (A.19) 

where 

^ = \l^^ '" a t% (A.20) 

Using the inequality (1A.15I) . we can similarly derive the estimates 

J 2 = 0(iY r2a ™ 1 iV ( ' 2/3 ~ 1 ' ) ), J 3 = 0{N < **- x) N 2f *- 1 ). (A.21) 
If min(a, (3) > 1/2, we utilise (TATSjl to find 

J 2 = OiN^-^/P), h = 0(AT (Q+/3 - 1)/a ). (A.22) 
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Moreover, one can readily see from the inequality G\{x) < x (x > 0) that 

J 4 = 0(A^ a+/3 - 1 ). (A.23) 
It follows from flA~T6l) . flA19|) . (EOT]) . flA~22]) and (IA~23]) that 



AT M 



E E G 1 ( P NP j Q k ) < £ /„ = o(N), 
j=i k=i 



(A.24) 



which yields (1A.4I) . 
Step 2 

We next prove 

Using 

we see that 



oo / -i TV M 



£=2 



j=l fc=l 

G (x) = 1 - e" 



(A.25) 
(A.26) 



E — ^ — zJ E UjkSjk) 



j=i k=i 



oo c£ N M 
^ \ ~* '-'max \ ^ \ ft 

- z^ z^ z^ -/jfc 

1=2 c j=l k=l 

oo ni N M 

= E -7* E E GoipNP^y. 

1=2 1 j=l k=l 



We can again employ (1A.8|) to obtain 



W M 4 

EE G o(pA^p,Q fe ) £ <E^ 
i=i fc=i 



(A.27) 



(A.28) 



u=l 



where 



i-N rM I 

Ji = dx dy G [pN- 
J 2 = ^ dyGolpiV- J 



x y~ 



J 4 = GolpN 



1 1 



Cv(«)Cm(/3), 



h = j" dx G (pN 



x 



Ctv(«) (mW), 



Cjv(«) Cm(/3) / 

(A.29) 
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Making use of the identity 

G (x) <x, x>0, (A.30) 

we find 

J 1 = (n^nM) , (A.31) 

where 

f N^/ 2 , i < 1/a, 

N {aA = J N (2a-l)/(2a) ^ ^ £ = ^ (^33) 

In the case a + /3 > 1, by means of 

g»w<{i; "li,- 1, < A33 > 

we obtain 

' 0{N^), a > 1/2, /3 > 1/2, 

oj^-MnA^), a > 1/2, /? < 1/2, 1 = 1/p, 

J x = J oi^ 20 - 1 ), a > 1/2, p < 1/2, £ ^ 1/p, (A.34) 

O^^lnJV), a < 1/2, p > 1/2, £ = 1/a, 

k Oi^- 1 ), a < 1/2, /3 > 1/2, £ ^ 1/a. 

Here the symbol N^ a '^ is defined in (IA.20D . The inequality (1A.33j) similarly 
gives the estimates 



J 2 



J 3 = J 0(W a+ P- 1 » a lnN), £=l/a, (A.35) 



Moreover it is evident from the inequality Gq(x) < 1 (x > 0) that 

J 4 = 0(1). (A.36) 
Now we can easily see from flA~3T]) . flA~34l) . flA~35|) and flA~36|) that 

TV AT 4 

£ £ GoipNPjQk)' < £ J, = o(JV) (A.37) 
j=i fc=i i/=i 

for any £ > 2. This relation results in the asymptotic estimate (1A.25|) . 



0{N 1+i ^), 


£ < 1//3, 


Q( N (a+P-l)/f} miV ) 5 


£ = 1//3, 




£ > 1//3, 




£ < 1/a, 


Q^ N (a+p-l)/ a ln]V ) ? 


£= 1/a, 


Q^jy(a+/8-l)/a\ 


i > 1/a. 
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